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RANK COMPLEMENT OF RATIONAL DYCK PATHS AND 
CONJUGATION OF (m,n)-CORE PARTITIONS 

GUOCE XIN 


Abstract. Given a coprime pair (m, n) of positive integers, rational Catalan numbers 
—1—combinatorial obiects: rational (m, n)-Dyck paths are lattice 
paths in the m x n rectangle that never go below the diagonal; (m, n)-cores are parti¬ 
tions with no hook length equal to m or n. Anderson established a bijection between 
(m, n)-Dyck paths and (m, n)-cores. We define a new transformation, called rank com¬ 
plement, on rational Dyck paths. We show that rank complement corresponds to con¬ 
jugation of (m, n)-cores under Anderson’s bijection. This leads to: i) a new approach to 
characterizing n-cores; ii) a simple approach for counting the number of self-conjugate 
(to, n)-cores; iii) a proof of the equivalence of two conjectured combinatorial sum for¬ 
mulas, one over rational (to, n)-Dyck paths and the other over (to, n)-cores, for rational 
Catalan polynomials. 


Mathematics Subject Classifications; 05A17, 05A19, 05E05 

Keywords: rational Dyck paths; core partitions; rational Catalan polynomials. 


1. Introduction 

Rational Catalan numbers are defined for a coprime pair (m, n) of positive integers by 

1 / m + n\ 1 /'m + n —1\ (m-|-n —1)! 

CS-bm.n = ~ I ) = I .. ) = j j ■ 

m + n\m,n J — mini 

It was known to count the set Dm n of rational (m, n)-Dyck paths in the m x n rectangle (see, 
e.g., i). To be precise, (m, n)-Dyck paths (for general are lattice paths from (0,0) to 

(m, n) that use unit steps (1, 0) or (0,1) and never go below the main diagonal line y = nx/m. 
The ordinary (n, n)-Dyck path is counted by the classical Catalan number Cat„+i^„, which is 
known [29] to count more than 200 distinct families of combinatorial objects. Since {n + l,n)- 
Dyck paths are easily seen to be in bijection with (n, n)-Dyck paths, this case is always referred 
to as the classical case. 

Rational Catalan numbers also appears in the context of partitions. Anderson established a 
bijection a from the set Dm,n of rational Dyck paths to the set Vm,n of (m, n)-cores, which are 
partitions having no hook lengths equal to m or n. Recently, Armstrong et. al. |3| established 
some interesting results and conjectures on (m, n)-cores. Some of the conjectures has been 
(partly) solved (See, e.g., [7|, [30], |32|), some of them are still open. 

Our first contribution is to define the rank complement transformation on (m, n)-Dyck paths 
in Section]^ Then we claim in Theorem |11| that under Ansderson’s map, rank complement of 
(m, n)-Dyck paths corresponds to conjugation of (m, n)-cores. Conjugation of (m, n)-cores was 
also described using semimodules in m Lemma 2.21]. This correspondence was not known 
before. See Armstrong’s talk |2| in 2012. Using this correspondence, we give a simple proof of 
the following result of [8]. 
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Theorem 1. Let (m,n) be a coprime pair. Then the number of self conjugate {m,n)-cores is 
given by 


/[m/2j + Ln/2J\ 
V L"i/2J, [n/2\ ) ■ 


The original proof of Theory gives a direct bijection from self-conjugate (m, n)-cores to 
lattice paths from (0,0) to ([m/2j, [n/2j). It is based on the fact that self conjugate partitions 
are uniquely determined by their hook lengths of the main diagonal. These main diagonal hook 
lengths are characterized by certain conditions for self conjugate n-cores (hence (m, n)-cores). 


Rational Catalan polynomials are g'-analogous of Cat^ 


C'3-tm,n(Q') — 


1 


[m + n]q [ m, n 


m -|- n 


defined by 
[m -|- n — l\q\ 


\m\ 


m 


where [a]q = 1 q°‘~^ and [a]g! = [a]q ■ ■ ■ [l]g. It is a nontrivial fact that 

is a polynomial in q with N coefficients when m and n are coprime. For this fact, Haiman 
gives an algebraic proof in m Prop. 2.5.2] and also gives an algebraic interpretation for these 
polynomials as the Hilbert series of a suitable quotient ring of a polynomial ring m Prop. 
2.5.3 and 2.5.4]. This polynomial also appears to be connected to certain modules arising in the 
theory of rational Cherednik algebras. Recently, it is shown in m that the modified version 
[gcd(m, n)]qCatm,n(<?) for arbitrary m and n is also a polynomial in q with N coefficients. 


An interesting problem is to explain the fact by finding a combinatorial interpretation of the 
rational Catalan polynomial Catm,n(^), especially of the form 

where stat is certain statistic on D, and Xm,n is a set counted by Catm,n- Such a solution 
was only known for the classical case by MacMahon |25j using the major index, and for the 
m = kn 1 case by [23] using the area and bounce statistic. In the general case, there are 
two conjectured formulas. One came up as a consequence of a more general rational Shuffle 
conjecture from algebraic combinatorics. 


Conjecture 2. Let {m,n) be a coprime pair of positive integers. Then we have 


^area(D)+codinv(D) ^ Catm,n{q) = 


DG.T)r) 


[m + n]q I m,n 


m + n 


( 2 ) 


where the sum ranges over all {m,n)-Dyck paths D, aTea,{D) is the number of lattice squares 
between D and the main diagonal, and codinv(T)) is a Dyck path statistic that can be given a 
simple geometric construction. 


The conjecture was also made in [H Conjecture 6], where dinv is denoted 

The other conjecture was made in the context of partitions by Armstrong et al. |3], where 
they introduced the statistics length i{X) and skew-length s£{X) of an (m, n)-core A. 


Conjecture 3. |3| Let m and n be coprime positive integers. Then we have 

Y. = = + " , 

^ [m + n\q [ m,n J 


^^'p7n,n 

where the sum ranges over all (m,n)-cores X. 


( 3 ) 


Both conjectured formulas are specialization of rational g, t-Catalan numbers at t = 1/q. 
The similarity of the two conjectures suggests that they are equivalent. Indeed, our major 
contribution is Theorem 17 which shows that under Anderson’s a map, codinv(L)) of a Dyck 
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paht D is taken to s£{\) of the (m,n)-core A = a{D). Since it is clear that area(iA) = ^(A), we 
prove the equivalence of Conjectures and 

It is worth mentioning the well-known Shuffle conjecture, which represents the Hilbert series 
of the diagonal Harmonics as a combinatorial sum over certain labeled Dyck paths, called 
parking functions. Shuffle conjecture is currently one of the major open problems in algebraic 
combinatorics. Since it was formulated in 2003 and published in |18] . little progress was made 
until a refinement of the conjecture was found 5 years later and published in [20]. Three 
special cases of the refined shuffle conjecture have been proved in [ID, nzj, m, but the 
method becomes more and more complicated for the general situation. 

While the classical shuffle conjecture is too hard to attack, its natural extension, the ratio¬ 
nal shuffle conjecture, has been discovered recently. The conjecture was found to be connected 
with many other area of mathematics, such as: the Elliptic Hall Algebra of Burban-Shiffmann- 
Vasserot, the Algebraic Geometry of Springer Fibers of Hikita, the Double Affine Hecke Al¬ 
gebras of Cherednik, the HOMELY polynomials, and the truly fascinating Shuffle Algebra of 
symmetric functions. Its specializations at t = q~^ (including the classical cases) are still open 
to this date. What makes this specialization particularly fascinating is that both sides of the 
stated identities have combinatorial interpretations. As a consequence, Conjecture]^ is already 
quite challenging. 

The paper is organized as follows. Section 1 is this introduction. Section introduces nota¬ 
tions on rational Dyck paths and the rank complement transformation. In trying to understand 
its relation with conjugation of (m, n)-cores, we find Theorem in Section which gives a 
relation between n-cores A and it conjugate A^. This leads to a new approach to characterizing 
n-core partitions. In Section]^ we introduce Anderson’s bijection between (m, n)-Dyck paths 
and (m, re)-cores and give a new proof of Theorem In Section we introduce the dinv 
statistic and establish the equivalence of Conjectures]^ and 

2. Rational Dyck paths and the rank complement transformation 

2.1. Notations. In this note, a path P = pi ■■■ pn is an {N, E)-sequence depicted in the plane 
as a sequence of lattice points {Pq, ..., Pn) such that Pq = (0, 0) (if not specified) and Pi — Pj_i 
equals (0,1) ii pi = N and (1,0) if pt = E. Thus N simply means going north and E means 
going east. The product of two paths P and Q are the juxtaposition PQ of the NE sequences 
of P and Q. Or equivalently, PQ is the path obtained by putting the starting point of Q at 
the end point of P. 

Let m and n be positive integers. We denote by Prn,n the set of (free) paths from (0, 0) 
to {m,n). An (m, n)-Dyck path D is a path in Prn,n that never goes below the diagonal line 
y = ^x. We denote by Dm,n the set of all such rational (slope) Dyck paths. Define the rank 
of a lattice point (a, 6) by r{a,b) = mb — na. When {m,n) is a coprime pair, all the lattice 
points {(a, 6) : 0 < a < m, 0 < 6 < n} in the m by n rectangle are in bijection with their 
ranks except for r(0,0) = r(m, n) = 0. Thus we can encode a path P G Pm,n by its rank set 
r{P) = {r{Po),... ,r{Pm+n-i)} = {riPi), ■ ■ ■ ,r{Pm+n)} of m + n distinct ranks. The ranks 
can also be defined recursively by r{Po) = 0 and for i = 1 ,... ,m n, r(Pi) = r(Pj_i) -|- m, if 
Pi = N and r(Pj) = r(Pj_i) — n if pi = E. Then P G Pm.,n is a Dyck path if and only if all its 
ranks are nonnegative. 

Denote by S{D) the set of south ends of D, i.e, starting points of an N step of D. By abuse 
of notation, it is convenient to denote also by S{D) = {so, si,..., Sn-i} the set of the ranks 
of the south ends of D. We claim that S{D) mod n = {0,l,...,n — 1}. This is because two 
lattice points with the same y-coordinate must have the same rank when modulo n, and the 
y-coordinates of the Sj are all different. We can similarly define E{D), N(D),W{D) to be the 
ranks of the east ends, north ends, and west ends of D respectively. We have the following 
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equalities: 

E{D) = W{D)-n, S{D) = N{D) -m, (4) 

r{D) = S{D)^W{D) = E{D)^ N{D), (5) 

where tt) means disjoint union. Equations in Q are obvious; Equations in ([^ follow from the 
fact that each node of D is either a south end or a west end, and similarly is either an east 
end or a north end. Note that 0 is a south end as the node (0, 0) and an east end as the node 
(m, n). On the other hand, given the rank sequence r{D), one can easily reconstruct the Dyck 
path D. For a rank r G it is in S{D) if and only if r + m G t{D), and similar results 

hold for W{D), N{D) and E(D). 


2.2. Transformation of lattice paths. There are two elementary transformations of paths 
(not necessarily in Denote by the reverse path of P obtained by reversing the NE- 

sequence of P, without changing the starting and ending point. Geometrically, this corresponds 
to rotating P by 180 degrees. The rank sequence of P and P^®’' are related by 

j.^prev^ _ point of P) + r( start point of P) — r(P). 

Denote the transpose of P by P^ = Geometrically, P^ is obtained from P 

by flip along the line y = —x by 180 degrees. The following two results are immediate. 

Lemma 4. Suppose m and n are coprime. A set R = {rg,... ,rm+n-i} is the rank sequence 
of a path P G Pm,n if o-nd only if it is also the rank sequence of the transpose P^ G Pn,m of P. 
The result still holds if we restrict to nonnegative rank sequences and Dyck paths. 

Lemma 5. Suppose m and n are coprime. A set R = {rg,... ,rm+n-i} is the rank sequence 
of a path P G Pm,n if and only if —R = {— rg,..., —rm+n-i} is the rank sequence of the path 

P rev rz TT 

t m,n' 


The reversing map is clearly an involution on Prn,n- Its fixed points are self-reversing paths, 
or equivalently, palindromic NE-sequences. Then such P can be factored as for some 

path Q. Since and Q have the same number of N steps and E steps, e is empty if m and 
n are both even, is N if n is odd, and is E if m is odd. We have 


#{P e Pm,n : P = P^^^} 


f[m/2\ + [n/2\\ 
V lm/2\,ln/2\ )' 
0 , 


if m or n is even; 
if m and n are both odd. 


( 6 ) 


2.3. Rank complement of rational Dyck paths. The situation is a little subtle when 
restricted to the rank sequences of Dyck paths: has negative ranks. To settle this problem, 

define the rank complement l) of D to be the path obtained by first sliding the part before 
the highest rank so that the rank 0 node (0,0) becomes the other rank 0 node (m, n), then 
rotating the path by 180 degrees, and hnally shift the path so that the lowest rank becomes 0. 
To be more precise, if we write the NE-sequence of D as Q1Q2 so that the end point of Qi has 
the highest rank, then D = {Q 2 QiY^'" = QY'^Q'Y'". See Figurefor an example. 

The following result justifies the name of “rank complement”. 

Lemma 6 . Suppose m and n are coprime positive integers. A set R = {rg, ..., rm+n-i} 
is the rank sequence of a Dyck path D if and only if its rank complement R = M — R = 
(M — rg,..., M — rm+n-i}, where M = maxP, is the rank sequence of D. 

Proof. For the sufficient part, we prove the equality r(D) = r(P) in two ways. From the 
geometric construction, we notice that sliding along the diagonal does not change the ranks, 
rotating the path gives the rank sequence —R with minimum rank —M, and the final shifting 
will give —R + M, as desired. 
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Figure 1. The transpose D^, the Dyck path D, and the rank complement D. 


The alternative proof is by using the formula D = where we split D as Q 1 Q 2 , and 

regard Q 2 and as paths starting at the highest rank M. The desired formula follows by 
observing that = M — r{Qi) for i = 1, 2. 

The necessary part follows from the sufficient part and the fact D = D, or equivalently 
R = R, which is obtained by max^ = M — (mini?) = M. Alternatively, note that ends 
at the highest rank M of D, so that D = is the desired splitting at the highest rank. 


The rank complement transformation is an involution on 'Drn,n, i-e., D = D. When restricted 
to the ranks of the south ends or east ends, we have the following result. 

Lemma 7 . Suppose m and n are coprime and D is an {m,n)-Dyck path. Then we have 
S{D) = max(5(ii)) — S{D) and E{D) = ma,x(E{D)) — E{D). 

Proof. We only prove the equality for south ends. The equality for east ends is similar. 

First observe that M = max r(ii) = max5(ii) + m = Mg + m. If Si is a south end, then 
Si + m € r[D) is a north end of D. Thus M — Si and M — {si + m) both belongs to r{D). It 
follows that M — Si — m = Mg — Sj is a south end of D. Together with D = D, we deduce that 
S{D) = Mg — S{D), as desired. 

On can also see that south ends of D become north ends of D by the geometric construction 
of D. I 


We conclude this section by the following analogous result of Equation 


(§. 


Theorem 8. Let {m,n) be a coprime pair. Then the number of self rank complement {m,n)- 
Dyck paths is given by 


#{D G 'Dm,n : D = D} 


nm/2\ + [n/2\\ 
V [m/2\,[n/2\ J' 


(7) 


Proof. We construct a bijection 'k from the set A of self-rank complementary Dyck paths to 
the set B of paths with m' = [m/2j E steps and n' = [n/2j N steps. The theorem then follows 
since the latter set clearly has cardinality ) ■ 

It is convenient to allow the use of half N and half E steps. We use the rank system of Em,n 
through out the proof of the theorem. That is, a point (a, b) has rank bm — an. 
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Given a Dyck path D with D = D, we split D at its highest rank 2M into two palindromic 
paths. Then we can write D = Q 2 where each Qi may start with a half step. Let 

Q = QiQ^2^■ If Q starts with or end with (or both), then set ^{D) to be the path 
Q with the half steps (if any) removed; otherwise, set 'I'(D) to be the path with the half 
steps removed. 

To see that ^{D) G B, we observe that even m and even n can not be coprime, and that 
half N step appears if and only if n is odd and half E step appears if and only if m is odd. 
Thus the type of the half steps is determined by the parity of m and n. 

Conversely, given a path in B, adding at the end if n is odd, and adding at the 
beginning if m is odd, reversing the resulting path if need to get a new path Q' satisfying 
maxr{Q') + minr(Q') > 0. Note that this is always possible since = —r(Q') (Q' 

starts at (0,0) of rank 0 and ends at {mj2,nf2) of rank 0). Split Q' at the highest rank to get 
Q' = Q'iQ'2^^ ■ Finally set D' = Q'xQ'2^^ Q'2 1° b® fl^® inverse image. 





Figure 2. An example for the bijection 'h, where {m,n) = (11,7). The 
top right picture is the intermediate step. 


To see that D' G A, we only need to check that min r(i7') = 0 and Q' = Q. Indeed, if we 
set M = maxr(Q'), then 

riQ'r^Q,) = riQ'r^) U (M + riQ[)) = (M - riQ[)) U (M + r{Q[)). 

Thus is a path starting at lowest rank 0 and ending at the highest rank 2M if and 

only if Q'l is a path starting at rank 0 ending at highest rank M and having all ranks larger 
than —M. Similarly, I® ^ path starting at highest rank 2M and ending at lowest rank 

0 if and only if is a path starting at the highest rank M, ending at rank 0 and having all 
ranks larger than —M. Therefore Q' satisfies maxr((20 + minr((5') > 0 if and only if D' G A 
and max r(Il') = 2maxr((20- I 


3. An alternative approach to u-core partitions 

A partition of n G N is a weakly decreasing sequence A = Ai > • • • > Aa > 0 of positive 
integers such that n = |A| = Ai + • • • + Aq. The integer n is also called the size or area of A 
and denoted by A h n. The Tth part is A*. The length of A is i{X) = a, the number of parts 
of A. The empty sequence is regarded as the unique partition of 0 with length 0. A partition 
A is usually identified with its Ferrers-Young diagram, which consists of A* left justified boxes 
(or nodes, cells) in the i-th row from the top. Then a cell c = (7 j) belongs to A if and only if 
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i < £(A) and j < Xi- The hook number h{c) of a cell c is defined by h{c) = 1 + arm(c) + leg(c), 
where 1 corresponds to c itself, the arm arm(c) is the number of cells to the right of c, and the 
leg leg(c) is the number of cells that are below c. Flipping along the main diagonal gives the 
Ferrers-Young diagram of the conjugate of A, denoted = (A'^,..., A'^)>. Then |A^| = |A| and 
A' is just the number of boxes in the f-th column of the diagram of A. Conjugation transposes 
c = (i, j) in A to c' = (j, i) in A^, with arm(c) = leg(c'), leg(c) = arm(c') and hence h{c) = h{c'). 
For example, A = (5, 4, 2,1) is a partition of 12 with 4 parts. Its conjugate A^ = (4,3, 2, 2,1) 
has Ai = 5 parts. See Figure for an illustration of the above terminologies. 


8 

6 

3 

1 

6 

4 

1 


4 

2 


3 

1 


1 




orm=3 





Figure 3. Partition A = (5,4,2,1), the conjugate A^ = (4,3,2,2,1), A 
with hook numbers put in the boxes, and similar for A^. 


A partition A is said to be an n-core if all the hook lengths of A are not divisible by n (or 
equivalently, equal to n). The A in Figure]^ is a 5-core. Core partitions were introduced by 
Nakayama in the theory of symmetric group representations mm- 

Denote by Hx = {Ai -|- a — 1, A 2 -L a — 2,..., Aa}> the set (arranged decreasingly) of the first 
column hook lengths of A. Then a set of positive integers H uniquely determines a partition A 
such that H = Hx- 

Given a positive integer n and a set H = {hi ,..., ha}> of positive integers, define 

Si = = max((n -|- H) U {z} C (nZ -|- i)), for 0 < i < n — 1, 

and let S^{H) = {sq; • • ■ j (We will often omit the superscript n when it is clear from 

the context.) In words, if there exists an h € H with h = i mod n then Sj — n is the maximum 
of such h, otherwise Si = i. Clearly, we have max S{H) = hi + n. We say H is n-flush at i if 
H n (nZ -|- i) is either empty (hence Si = i) or {i,n + i, ■ ■ ■, Si — n}. The set H is called n-flush 
if it is n-flush at z = 1, 2,..., n — 1 and sq = 0. In other words, every h € H is not divisible 
by n and h ^ H implies that h — n is either negative or belongs to H. Thus S{H) is a natural 
encoding of the n-flush set H. Later we will see that in a different context, S{H) corresponds 
to the ranks of the south ends of a Dyck path. 

Theorem 9. Suppose the first column hook lengths Hx = {hi ,..., ha}> of a partition A is an 
n-flush set. Then Hxt is also n-flush and 

S{Hx) = hi+n-S{HxT). (8) 

Proof. We prove the the theorem by induction on the length a of A. Equation Q clearly holds 
when A is empty. If a = I then hi = Ai < n for otherwise hi — n G Hx, a contradiction. Now 
S{Hx) = {0,1,..., n — 1} \ {hi} U {hi -|- nj and 

S{Hx) = S{{hi,hi - I,..., I}) = {0,n -L I,... ,n -L hi,hi -L I,... ,n - 1} 

= {hi -I- I,..., hi -b nj \ {nj U {0} = hi -b n - ({0,..., n - 1} \ {hi} U {hi -b n}), 

which is just hi-\-n — S{Hx) as desired. It is also clear that {hi} is n-flush if and only if hi < n, 
if and only if A = (hi)> is an n-core. 
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Now assume a > 2 and we proceed the induction on a for the theorem. Denote by H' = 
= {h'l ,..., /i^}< the first row hook lengths of A. This is also the first column hook lengths 
of A^. Then 6 = Ai is the length of A^. Clearly hi+n = h'^+nis the maximum of both S{Hx) 
and S{H'^). Let ^ be the partition obtained from A by removing the hrst row. Then the hook 
lengths of the first column of /r is just = {/ 12 ,..., ha}<, which is also n-flush. Since Hx is 
n-flush, hi — n is either negative or belongs to Hx- It follows that /12 > hi — re, or equivalently 
hi — ^2 < re, and that S{Hx) and 5'(hh^) differ by only one element, i.e., S{Hx) has hi +re but 
has hi. In formula we have 

S{Hx) = S{H^)\{hi}U{hi+n}. (9) 

Let G' = H'^ = { 5 '^,... ,5c}> be the first row hook lengths of Then c = A 2 and g'^ = h 2 . 
By the induction hypothesis, G' is re-flush and Equation ^ holds for /r: 

S{H^) = h 2 + n-S{H'^) = h 2 + n- S{G'). (10) 

In particular hi G S{H^) implies that h 2 + re —hi G S{G'), that is, Sn-hi+h 2 {G') = n — hi + h 2 . 

Claim: the set is re-flush, and the following equation holds. 

S{H'x) = + hi - h 2 ) \ {re} U {0}. (11) 

Assuming the claim holds, we can complete the induction by the following computation. 
hi+n- S{Hx) = hi+n - {S{H^) \ {hi} U {hi -b re}) (by 0) 

= (hi -b re - S{H^)) \ {re} U {0} 

(by @) = (hi - h 2 -b 5(iL^)) \ {re} U {0} 

(by @) = S{H'x). 

To show the claim, observe that h'- — s'' = 6 — c -b 1 for j = 1, 2,..., c and h}_,_i,..., h} are 
given by h} — 5 } — 1,..., 2,1. In formula we have 

i/' = (6 - c + 1 + G') U {1,2,..., 6 - c} = ((5 + G') U {1,2,..., 6 - c}, 

where we have set <5 = 6 — c-bl = hi — h 2 for convenience. 

Since G' is re-flush, it is re-flush at i for each i. Thus G'n (f -breZ) = {i, re-bi,..., Si{G') — re}, 
where this set is taken to be empty if Si{G') < re. We have 

ih' n (h + i + reZ) = ((J + G') U {1,2,..., 6 - c}) n (<5 + i + reZ) 

= ((5 -b {G' n (i -b nZ))) U ({1, 2,..., 6 — c} n (h -b f -b reZ)) 

= {z -b h, i -b re -b (5,..., Si{G') — re -b h} U A, 

where A is {6 + i — n} ifJ-bi > re and is empty otherwise. In the former case, since hi — h 2 < re, 
we have 0<h-bz — re<reso that H' is flush at <5 -b z — re with 5 + Si{G') G In the 

latter case, if J -b f < re then H' is flush at 5 + i with 5 -b Si{G') G in the only remaining 

case 5 + i = n, hy the assumption Sn-siG') = re — h < re, we have hh' n (re -b reZ) = 0 with 
6 + Sn-hi+h 2 iG') = n ^ S{H') but so{H') = 0 instead. This completes the proof since when i 

ranges over 0,1,..., re — 1, so does h} — g'l + i mod re. I 

Theorem establishes a simple connection between Hx and Hxt for re-core A. It is an 
important tool in our study of (m, re)-cores. One consequence of Theorem is the following 
classical result. This result has an elegant proof using the abacus notation of partitions. See, 
e.g., [I]. As a warm up and also for self-containedness, we include a new proof of this classical 
result. 

Corollary 10 . A partition A is an n-core if and only if Hx is n-flush. 
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Proof. The necessity follows by the fact that the n-flushness of Hx implies the n-flushness of 
and Hxt. Thus inductively the hook lengths of each row of A is n-flush, and hence contains 
no multiple of n. 


We prove the sufficiency part of the theorem by contradiction. We follow notations in the 
proof of Theorem Assume a is minimal such that A is an n-core of length a but Hx is 
not n-flush. Clearly we may assume a > 2. Use the notation for A and n as before. By the 
minimality of a, is n-flush. If6 — c = /ii — /12 — l>n then H'^ has n as a hook length of 
A. A contradiction. So assume hi — h 2 < n. By definition hi is not a multiple of n. Let j be 
the smallest number such that hi — jn is negative or belongs to Then j >2 since Hx is 
not n-flush but /x is n-flush. 


By Theorem]^ (10) holds. It follows that /i 2 + n — {hi — jn + n) = h 2 — hi+ jn G S{H'^), 


so that jn + h 2 — hi — n > 0 appears as a hook length in H'^ for some k < c. Then 
“ ^2 = jn h 2 — hi — n + hi — h 2 = jn — n appears as the hook length contradicting 
the assumption that A is an n-core partition. I 


4. Conjugation of (m, n)-coRES and rank complement of Vm,n 

A partition A is said to be an (m, n)-core if it is both an m-core and n-core. By Theorem 
1^ A is (m, n)-core if and only if Hx is (m, n)-flush, i.e., Hx is both m-flush and n-flush. When 
m and n are relatively prime, h G Hx can be uniquely written as h = am — bn for 0 < b < m. 
We claim that a < n, so that h is the rank of a lattice point in the m by n rectangle. If a > n 
then we can write h = [a — n)m + (m — b)n. Then the n-flushness of Hx implies that a n 
and that h — (m — b)n = (a — n)m is also in Hx, which contradicts the m-flushness of Hx- 

Now for a coprime pair (m, n), we identify Hx with the ranks of lattice points V inside the 
m by n rectangle. Then the (m, n)-flush property says that h G Hx implies that h — m and 
h — n, if positive, are also in Hx- This corresponds to that if {a,b) G V then (a -|- 1,6) and 
(a, 6 — 1) are also in V, provided that they are above the diagonal. Such V are exactly the 
lattice points to the right of an (m, n)-Dyck path D. This gives Anderson’s bijection that takes 
D to a{D) = A by setting Hx to be the the positive ranks of the lattice points to the right 
of the (m, n)-Dyck path D. The set S{Hx) is exactly the ranks of the south ends of D. See 
Figure]^ for examples. 





Figure 4. Anderson’s bijection for {m,n) = (8,5): Dyck path D, X = 
a{D), and the rank complement D. The hrst column hook lengths of A 
are the ranks to the right of D, and the hrst row hook lengths of A are the 
ranks to the right of D. 


If a partition A is an {m,n) core, then clearly so is its conjugate A^. A natural question is 
what is the relation between the paths a“^(A) and a“^(A^). See Figure|^for an example. At 
the first glance, the two paths seems very different. But we have the following result. 
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Theorem 11. Suppose m and n are coprime and D is an {m,n)-Dyck path. Then the (m,n}- 
core a{D) is just the conjugate of the {m,n)-core a{D). 

Proof. Denote by A = a{D) and A' = a{D). Then max5(D) = max 5(D) = hi{\) + n = 
/ii(A') + n. By Lemma 

5(Dv) = 5(D) = hi + n- S{D) = hi + n- S{Hx), 

where H\ and H\> are regarded as n-flush set. 

By Theorem]^ we also have S{Hxt) = hi + n — S{H\). It follows that S{Hxt) = S{Hy)^ 
and hence H^t = Hx' and A^ = A'. This completes the proof. I 


Combining Theorems 11 and[^ 


we recover Theorem 


5. The DINV statistic on Vm,n and the skew-length for (m, n)-CORES 


5.1. The area and dinv statistics for rational Dyck paths. We introduce two important 
statistics on an (m, n)-Dyck path D G Dm,n for general pair (m, n) of positive integers. The 
area area(D) of D is the number of lattice boxes between D and the diagonal line y = 

The dinv statistic arose in the theory of parking functions. When restricted to Dyck paths, 
dinv(D) of D specializes to the following geometric construction: It counts the number of cells 
c of the partition above the path whose arm and leg satisfy the inequalities 


arm(c) 
leg(c) -h 1 


m 


< — < 


n 


arm(c) + 1 
leg(c) 


In Figure]^ we have placed a green square in each of the cells that contribute to the dinv(D) 
(in the left picture) and dinv(D^) (in the right picture). 



Figure 5. The dinv statistic and transpose of Dyck paths 


An immediate consequence of the geometric construction is the following. 
Proposition 12. For every rational Dyck path D G Dm,n, we have 

dinv D = dinv D^. 
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The dinv statistic also appeared as the /i+ statistic. See, e.g., [3]. Alternative descriptions 
of dinv have been found useful. The one in [U Lemma 11] can be stated as follows: If D is 
encoded by a sequence {Pq, . .., Pm+n) of lattice points, then we have 

dinv(Zl) = < j : Pi € W{D),Pj G S{D), and 0 < r(Pj) — r{Pj) < m + n}. (12) 

Now we concentrate on the case when (m, n) is a coprime pair. Our language translate the 
dinv statistic as follows. 

dinv(D) = ^{0 < Vw — Vg < m + n : & W{D),rs G S'(Il),ru, proceeds r^}, (13) 

where “proceeds” refers to the corresponding lattice points of and rg in D. 

For a coprime pair {m,n), consider the m x n rectangle. The number of lattice boxes to 
the left of the diagonal is (m — l)(n — l)/ 2 , as the diagonal hits a ribbon of m + n — 1 boxes 
(the purple boxes in Figure]^, and the ribbon divides the rest of the rectangle into two equal 
pieces. Thus the maximum value of area(D) over D G Pm,,n is This is also the 

maximum of dinv(Il) by the geometric construction. It is natural to use the notations 

/ (m — l)(n — 1 ) , (m —l)(n —1) , 

coarea(Zl) =- - -area(Il), codinv(Il) =- - -dinv(Zl). 

Definition 13 (The Sweep Map). Suppose a Dyck path D G Vm,n is encodes by its NE-sequence 
D = Pi ■ ■ -pm+n- Then the sweep map d>(P) is obtained by sorting the steps pi into increasing 
order according to the ranks of their starting points. 


For example, take (m, 
ranks are computed as 

n) = (7,5), and P = 

NNEENNENEEEE. Then the path and the 


’ N 

N E E N 

N 

E 

N 

E 

E 

E 

E ' 



0 

7 14 9 4 

11 

18 

13 

20 

15 

10 

5 


Sorting the path according to the ranks gives 









’ N 

N E N E 

E 

N 

N 

E 

E 

E 

E ' 



0 

4 5 7 9 

10 

11 

13 

14 

15 

18 

20 


and thus 4>(P) = NNENEENNEEEE. 









It is true but not obvious that <1>(Z1) is 

still 

in 


See 

m 

for 

a proof. The dinv statistic 


is closely related to the map by the following result. 

Theorem 14. Let (m,n) be a coprime pair. Then for an {m,n)-Dyck path D, we have 
dinv(Zl) = area(<l>(D)), and consequently, 

codinv(Zl) = coarea(4>(Zl)) = ff{{rs,rw) : rg G S'(D),r^ G W{D),rg < ry,}. 

Theorem |14| holds for general m and n with certain modihcations. This is one of the results 
in |24l Theorem 16]. A bijective proof of codinv(D) = coarea(d>(Zl)) can be found in |15j . 

Corollary 15. Let {m,n) be a coprime pair. Then the rank complement transformation pre¬ 
serves the dinv statistic. In other words, for any (rn,n)-Dyck path D, we have 


dinv(D) = dinv(Zl). 
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Proof. It is sufficient to show that codinv(D) = codinv(L)). Recall that r{D) = M — r{D), 
where M = maxr(D). We have 

codinv(Z)) = G S{D),fw G W(D),fs < f^} 

= #{{rn, Te) : Tn G N{D),re G E{D), M - Tn < M - Te] (work in D) 

= #{{fe,rn) ■■ Tn G N{D),re G E{D),re < Tn} 

= G W{D^),rs G S{D^),rs < r^} (work in D^) 

= codinv(R)^) = codinv(Ii)). 


Remark 16. Sweep map has become an active subject in the recent 15 years. Variations and 
extensions has been found, and some classical bijections turns out to be disguised sweep map. 
See [5j . One major conjecture in this area, in its simplest form, is that the <I> map is a bijection 
from the set 'Drn,n of Dyck paths to itself. The conjecture has only been shown for some special 
cases. 


5.2. Skew-length of (m, n)-cores. For an (m,n)-core A, its skew length (the super¬ 

script m, n will be omitted if it is clear from the context) was defined in [3] to be the number 
of boxes that are both in the m boundaries and in the n-rows. The m boundaries are the set 
of boxes whose hook length is less than m; the re-rows is better described in our language: if 
H = Hx = (hi, ..., is the first column hook lengths of A, then the f-th row is called an 
re-row if hj -|- re G S'^{E[) for the re-flush set H. 

The following is an example of an ( 8 , 5)-core A = (9, 5, 3, 2 , 1 , 1 ). The hook lengths of A is 
put to the right of ||. The left most column are hi mod 5 and we have underlined the 5-rows, 
and bold faced the 8 -boundaries. Thus si{X) = 6 -|- 3 -|- 1 = 10. 


4 = (14 mod 5) 

14 11 9764321 

4 = (9 mod 5) 

9 6 4 2 1 

1 = (6 mod 5) 

6 3 1 

4 = (4 mod 5) 

4 1 

2 = (2 mod 5) 

2 

1 = (1 mod 5) 

1 


Theorem 17. Let m and re be coprime positive integers. Then for any {m,n)-Dyck path D 
we have 


codinv(iA) = s£{a{D)). 

Consequently, the skew length statistic of an [m,n)-core A is invariant under conjugation and 
switching the roles of m and re. In formula, we have 

= sr’^{x) = sr’^ix'^) = sr’^ix'^). 

To prove Theorem[^ we need a better description of s£{X). Let A = Ai > • • • > A^ > 0 be an 
(rre, re)-core with H = Hx = {hi,..., ha}>. Denote by A* = A* > • • • > A^ the partition obtained 
from A by removing the first i — 1 rows. Then A^ = A. Denote by = ih(A*) = (hj,..., ha). 
Then the f-th row hook lengths of A is just the fist row hook lengths of A*, which is 
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Proof of Theorem 11. The number of boxes in row i and also in the m-boundaries is: 


n {1,2, ... ,m - 1}| = 
(by Theorem]^ = 


■‘>m \ 


iP)T 

{h,-s^{W))nz^o\ 

{s^{W) - hi) nz^ol 

(5”^(if)-h*)nz<o|, 

where in the last step, we use the m-flushness of H, which implies that (recall that s'p{H^)—m < 
hi by definition) 

W n {j + mZ) = {sf{W) - m,.. .,m + j,j} = {s™(i?) - m ,... ,m + j,j} nZ<h„ 

and hence < hi if and only if s'p{H) < hi. 

If A = a{D) then S^{Hx) is just S{D) and S^{H\) is just E{D). With these arguments 
handy, we derive that 

sl’(A)= |i/(A*)^n{l,2,...,m-l}| 

= J] |(5”^(if)-h,)nz<o| 

/ij+neS"(R) 

= \{{rs,re) ■ Vs G S{D),re G E{D),rs - re - n < 0}| 

= |{(?'sT«>) : rs G S{D),ru, G W{D),rs - < 0}|. 


This is exactly the coarea of d*(-D), which is equal to codinv(iA) by Theorem 14 
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